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Teaching for Professional Competence: 

Instructional Practices that Promote Development of Design and Team-Building Skills 

Abstract 

Research on teaching and learning in the college classroom suggests that students’ gains in 
subject matter learning are influenced by many factors including students’ pre-college 
characteristics, teaching practices, and students’ perceptions of classroom climate for women and 
minorities. One purpose of this study was to determine whether these same factors (pre-college 
characteristics, teaching practices, and climate) are reliably related to gains in students’ 
professional competencies. A second purpose was to investigate whether teaching practices and 
classroom climate have differing impacts on White male and female students’ development of 
professional competencies. Results indicate that the vitality of the classroom experience matters 
on a student’s gains in professional competency. Teaching practices as a group were found to 
contribute above and beyond personal characteristics do in self-reported gains in group skills, 
problem solving and design skills among undergraduate engineering students. Findings also lend 
mixed support for the differential learning styles hypothesis between women and White men. 
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TEACHING FOR PROFESSIONAL COMPETENCE: 
INSTRUCTIONAL PRACTICES THAT PROMOTE DEVELOPMENT 

OF 

GROUP, PROBLEM-SOLVING, AND DESIGN SKILLS 

Higher education leaders from various venues are calling for stronger links between college 
teaching and the skills students need to develop for use in their post-college careers. Developing 
students’ professional competencies is a major concern of university presidents (Kellogg 
Commission, 1997), higher education scholars (Stark & Lowther, 1989; Jones, 1996), faculty 
senates (Janesch, 1996), and regional and specialized accrediting agencies (Lopez, 1996; ABET, 
1998). In 1992, for example, the National Educational Goals Panel (1992) emphasized that 
student developmental outcomes such as critical thinking, problem solving, effective 
communication and responsible citizenship should be key issues when judging the effectiveness 
of its institutional affiliates. Industry leaders asset that new graduates must have abilities to work 
in teams and to design solutions to real world problems (Black, 1994; Augustine, 1996). In 
addition, regional and specialized accrediting agencies are requiring member institutions to focus 
on teaching for professional competence. The North Central Accreditation Commission, for 
example, recently encouraged institutional evaluators to assess measures of students’ gains in 
group interaction skills, initiative, and problem solving skills. The Accreditation Board for 
Engineering and Technology (ABET), the sole agency responsible for accreditating engineering 
degrees in the US, recently enacted criteria requiring colleges of engineering by the year 2,001 to 
demonstrate their graduates have developed eleven competencies, including the abilities “to 
design systems or component, or process to meet desired needs”, “to function on multi- 
disciplinary teams”, and “to communicate effectively” (ABET, 1998). 

O 
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While there appears to be growing consensus about the competencies that undergraduate 
students should develop before they graduate, there is less clarity about how faculty can help 
students develop these competencies. According to Stark and Lowther (1989), few faculty 
discuss how to teach students for professional competence within or across disciplines. Since 
there is little information about the relationship between teaching and learning professional 
skills, we turned to literature on teaching and students’ gains in subject matter knowledge. 
Research on teaching and learning in the college classroom suggests that students’ gains in 
subject matter learning are influenced by many factors including students’ pre-college 
characteristics (Astin, 1993; Pascarella, 1985), teaching practices (Murray, 1991; Pascarella and 
Terenzini, 1991), and students’ perceptions of classroom climate for women and minorities (Hall 
& Sandler, 1982; Cabrera & Nora, 1994). One purpose of this study was to determine whether 
these same factors (pre-college characteristics, teaching practices, and climate) are reliably 
related to gains in students’ professional competencies. A second purpose was to investigate 
whether teaching practices and classroom climate have differing impacts on White male and 
female students’ development of professional competencies. 

Conceptual Foundations 

The conceptual framework for this study is depicted in Figure 1. The Teaching for 
Professional Competence model was adapted from several models of the impact of college on 
students including the Learning Outcomes model developed by Terenzini, Springer, Pascarella 
and Nora (1995). The Learning Outcomes model depicts student learning and development as 
the product of the interplay between a students’ pre-college characteristics and collegiate 
experiences. Student pre-college characteristics include ability, socio-economic status. 



educational aspirations, ethnicity and gender. The institutional context is composed of classroom 
and out-of-classroom activities. Classroom experiences include exposure to teaching methods, 
the curriculum and interactions among peers and with faculty. Out-of-classroom experiences 
include extracurricular activities, working on and off campus, and social interaction. Although 
the model postulates that both classroom and out-of-classroom experiences contribute to student 
development, classroom experiences appear to have a stronger and more varied effect on student 
outcomes (Volkwein, 1991; Volkwein & Lorang, 1996). In the revised Model of Student 
Integration, Tinto (1997) portrayed classroom experiences as the center point where students’ 
academic and social experiences in college converge. Therefore, the Teaching for Professional 
Competence model focuses on classroom experiences, and posits students’ pre-college 
characteristics, teaching practices, and classroom climate as predictors of gains in students’ 
professional competencies. 



Insert Figure 1 



Students’ Precollege Characteristics 

Ability and background : Scholars who have investigated college impact have shown that 
students’ characteristics at time of matriculation influence the ways and the extent to which 
students change as they progress toward graduation. In particular, students’ intellectual ability, 
their educational aspirations, and the education level attained by their parents influence students’ 
learning in college (Astin, 1993, Pascarella & Terenzini, 1991). 
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Gender : In addition, research has shown that, under some conditions, gender and race 
influence what and how students learn (Oakes, 1990). Opinions differ, however, about the 
reasons for gender and race-related learning differences. For example, scholars have suggested at 
least three reasons for gender differences in learning. For example, one reason may reside in 
essential differences in the ways that women and men learn. Belenky and associates (1986) assert 
that women may be more likely than men to engage in “connected knowing.” Connected 
knowing involves learning though relating with others and focuses on the subjective 
understanding of experience. In contrast, men (and some women educated in college by men) 
may be more likely than other women to engage in “separate knowing.” When engaged in 
separate knowing, individuals critically challenge alternatives for the purpose of deducing 
objective truth. If women are inherently more likely than White men to prefer connected 
knowing, then women are also more likely than men to prefer collaborative learning with their 
peers and extensive interaction with their instructors. 

The influence of societal factors is second reason given for gender differences in learning 
(Oakes, 1990). According to this perspective, childhood socialization and differing career 
opportunities for males and females inhibit the development of women’s confidence and restrict 
women’s perceptions of appropriate college majors and jobs (Sax, 1994; Hacked & Betz, 1992). 
In addition, females’ preferences for collaborative learning and humanistic majors and males’ 
preferences for individual learning activities math and science majors are seen as the result of 
culturally-determined gender roles rather than as inherent sex-related differences in learning 
styles (Fennema & Sherman, 1977; Ferguson, 1984). Similar to the first reason, this explanation 
would also suggest that women would be more likely than White men to prefer opportunities to 
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interact with instructors and to engage in collaborative learning with peers. 

A third reason given by some scholars for gender differences in learning and persistence 
is differential treatment of men and women in school and college classrooms. Observational and 
interview studies that investigated students’ experiences in pre-college and college classrooms 
revealed that many teachers provide more attention and more specific feedback to male than to 
female students (Seymour & Hewitt, 1997; Sadker & Sadker, 1986; Hall & Sandler, 1982). 
Moreover, male students in science and engineering fields tend to devalue to contributions of 
their female peers (Seymour & Hewitt, 1997). As a result, female students may be more likely 
than males to avoid group work (Rosser, 1998) or to be disappointed with their experiences on 
mixed-gender collaborative learning projects (Felder, et al., 1995). 

Teaching practices 

Research on the impact of instructional activities on student learning is somewhat 
mixed. Kulik and Kulik’s (1979) review of research on college teaching effectiveness led them 
to suggest that learning has more to do with individual motivation to study outside the classroom 
than with what the instructor does in the classroom. Murray’s (1991) research on observable 
low-inference teaching behaviors led him to reach an opposite conclusion. However, Murray 
advises that the debate regarding the impact of teaching behaviors on student outcomes can best 
be informed by further research. 

Research design and measurement issues may have prevented researchers’ abilities to 
find conclusive evidence documenting the relationship of instructional activities to student 
learning (Abrami, 1985; Murray, 1991). Murray (1991) found fewer measurement problems 
when the studies about teaching focused on concrete and observable “low-inference” teaching 
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practices rather than when the studies rely on “high-inference” descriptors. “Student centered”, 
“Being friendly” are examples of high-inference measures in that they call for a high degree of 
inference and judgement on the part of the evaluator. A related low-inference teaching behavior 
is “the instructor encourages students to listen, to evaluate and to learn from the ideas of other 
students.” In comparison to high-inference measures, low-inference behaviors are less prone to 
interpretation bias and more likely to be reported by more than one observer. According to 
Murray (1991), however, most research on low-inference teaching behaviors has emphasized the 
relationship between teaching behaviors and student ratings of instruction. More research is 
needed to explore the relationship between teaching behaviors and gains in student learning. 

Research on college teaching has shown that teaching practices are multidimensional in 
nature. Moreover, the effectiveness of each dimension appears to vary as a function of the 
student outcome under consideration (McKeachie, 1990; Murray, 1991; Kulik & Kulik, 1979). 
Teacher clarity, for instance, has been found to correlate with student achievement (Feldman, 
1989), and student motivation to re-enroll in courses (Murray, 1991). Continuous, specific and 
immediate feedback has been found to improve achievement (Kulik & Kulik, 1979). While both 
lecturing and class discussion have been found to correlate with students’ acquisition of 
knowledge, class discussion appears to be more effective for enhancing problem solving skills 
(Kulik & Kulik, 1979). In addition, research indicates that students’ critical thinking skills are 
positively influenced by class discussions, by encouragement from the teacher, and by teachers’ 
articulation of problem-solving procedures (McKeachie, 1988, Pascarella & Terenzini, 1991). 

While routine problem solving can be taught, according to Schon (1987), design cannot 
be taught using traditional lecture or discussion methods. Design is the art of developing creative 



solutions to open-ended problems and is a skill required in many professions (Schon, 1987). 
Students can learn design through practice as they are guided through frequent interactions with 
an experienced and encouraging coach (Dally & Zhang, 1993; Dym, 1994; Schon, 1987). 
Coaching involves interactive dialog, demonstrations, questioning, listening, clarifying 
objectives, understanding other’s viewpoints, and articulating design specifications (Dym, 1994, 
Schon, 1987). 

Collaborative learning involves collective intellectual effort among groups of students. 
The practice of collaborative learning in the college classroom is grounded in the assumption that 
the processes of engaging in social conversation about a specific task or problem enhances 
participants’ reflective thinking, and therefore their acquisition of knowledge (Bruffee, 1984). 
Students’ achievement, positive attitudes toward a subject area and emotional bonding with peers 
also appear to be positively influenced by cooperative and collaborative learning experiences in 
the classroom (Johnson, Johnson & Smith, 1991). To prepare college students for the workplace, 
more and more faculty are assigning students to work together to solve open-ended problems 
(Gamson, 1994). 

Classroom Climate 

While teaching practices affect the attainment of student outcomes, the classroom climate 
of tolerance towards diversity also appears to play a role. A classroom climate permeated by 
prejudice on the part of faculty and peers has emerged as an explanatory factor accounting for 
differences in college adjustment, majoring in hard sciences, and college persistence between 
White men, women and minority students (Cabrera & Nora, 1994; Hurtado, 1992, 1994; Eimers 
& Pike, 1997; Fleming, 1984; Seymour & Hewitt, 1997). Women may be more likely than men 



td leave science and engineering majors because of their perceptions of competitiveness and 
inferior instruction in technical fields (Strenta, Elliott, Adair, Matier, & Scott, 1994). Members 
of majority groups may also be negatively affected by a climate of intolerance. Researchers have 
shown that regardless of students’ gender or ethnicity, their perception that some students suffer 
from discrimination in the classroom has a negative effect on their own academic development 
and commitment to their institution (Cabrera, Nora, Terenzini, Pascarella, & Hagedom, 
forthcoming; Whitt, Pascarella, Edison, Nora & Terenzini, 1998). Thus, the climate for tolerance 
in a given class may also influence the extent to which students develop professional 
competencies as a result of taking that class. 

Gains in Professional Competencies 

Higher education scholars, industry leaders, accrediting agencies, and university 
presidents agree that four years in college should develop students’ communication, critical 
thinking, problem-solving skills. Whether the skills were learned in liberal education or 
professional school classes, a student who is competent at communication, critical thinking and 
problem-solving has much to offer potential employers (Jones, 1996; Stark & Lowther, 1988). 
Faculty members’, administrators’, and employers’ opinions about the essential skills that college 
students should develop were explored in studies conducted by Jones and associates (1994, 1997) 
Results of the Delphi studies revealed areas of consensus among the three groups of stakeholders 
about the components of critical thinking, problem solving and communication skills (Jones, et 
al, 1994, Jones, et al., 1997). 

Group interpersonal skills : Faculty, administrators, and employers agree that students 
should develop interpersonal and group skills, including identifying and adapting to the needs of 



others, motivating others, and managing interpersonal conflict (Jones, 1994). In the workplace, 
individuals frequently work in groups or teams to solve problems (Bucciarelli, 1988). Effective 
designs are more likely to result when team members can communicate with one another 
effectively (Bucciarelli, 1988, Schon, 1987). Research on workplace groups reveals that three 
types of communication are involved in effective group functioning: discussions about the task, 
discussions about the process for achieving the task, and communications about personal 
relationships among group members (Jehn, 1997). Therefore, it seems desirable that faculty 
foster classroom conditions that enable students to develop task, process and relational 
communication skills among team members. 

Problem solving skills .' Solving a problem involves several stages, including identifying 
the problem and generating, selecting, and implementing a solution (Dougherty & Fantaske, 
1996). Problem-solving often involves skills also associated with critical thinking, such as 
collecting and evaluating evidence, analyzing arguments, developing hypotheses, and drawing 
conclusions (Jones, et al., 1994). 

Design skills : Design involves solving complex and ill-defined problems that may have 
many solutions (Schon, 1987). In addition to creativity, design usually includes generating and 
evaluating specifications to achieve objectives and satisfy constraints (Dym, 1994). Design 
problems are central to science and engineering, architecture, art, music, business, and the health 
care. professions (Dougherty & Fantaske, 1996; Schon, 1987). The new accreditation criteria for 
engineering colleges requires that graduates with a bachelor’s degree demonstrate competence in 
design (ABET, 1998). 
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Methodology 



Sample and Data Collection 

Because engineering is a field in which accreditation criteria are currently changing to 
reflect the importance of competency development, this study focuses on the relation of teaching 
practices to gains in professional competencies in engineering classes. In Spring 1997, 480 
undergraduate engineering students from six universities in ECSEL, an NSF-funded coalition of 
engineering schools, completed a pencil-and paper, multiple-choice questionnaire. The 
Engineering Coalition of Schools of Excellence in Education and Leadership (ECSEL) includes 
City College of New York (CCNY), Howard University, Morgan State University, the 
Pennsylvania State University, the University of Maryland, the University of Washington and the 
Massachusetts Institute of Technology. The two primary goals of the ECSEL are to incorporate 
design in the undergraduate engineering curriculum and to increase the diversity of engineering 
graduates. At the participating schools, ECSEL classes are more likely than other undergraduate 
engineering courses to require students’ participation in team-based design projects. The 
questionnaires were administered in 17 ECSEL classes (N=339) and 6 non-ECSEL classes 
(N=141). 

The survey form gathered information in three categories; 1) students’ personal and 
academic background and demographic characteristics; 2) characteristics of the course in which 
they were enrolled when completing the questionnaire; and 3) the extent to which they believed 
they made progress in a variety of learning and skill development areas as a result of taking that 
particular course. The items comprising each of the three sections of the questionnaire were 
derived from learning theory, research on college students, Delphi studies by Jones and 



associates (1994) and ABET’s new accreditation criteria. (See Appendix A.) 

Table 1 displays the descriptive statistics of the scales and variables used in subsequent 
analyses. Seventy-seven percent of the respondents were males, and 45 percent were Caucasians. 
On average, the students’ parents had undergraduate degrees. The average student in this sample 
expected to complete a Master’s degree. Non-ECSEL students reported somewhat stronger pre- 
college academic credentials than did the ECSEL-course students. Compared to their ECSEL- 
peers, non-ECSEL students reported higher SAT scores (by 30 and 35 points on the verbal and 
math portions of the SATs, respectively) and high school grade-point averages. Each of these 
differences were statistically significant. No statistically significant differences were identified, 
however, between the two groups with respect to current engineering GPA or overall GPA. 
Students were approximately evenly distributed across the class years, with 25-27 percent in each 
of the freshman, sophomore, and junior classes, although slightly fewer (18%) were seniors. No 
significant differences in this distribution were identified between ECSEL and non-ECSEL 
course students. Ratings of classroom climate indicate that most respondents perceived that all 
students were treated the same regardless of gender or ethnicity. 



Insert Table 1 



Development of Indicators 

Indicators of Teaching Practices and Classroom Climate : Students were asked to report 
how often they or the instructor engaged in each of 26 classroom activities. The scale ranged 
from 1 to 4, where l=’never’, ‘2=occasionally’, ‘3=often’, and ‘4=very often/almost always’. 
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Twenty-four items were drawn from literatures on effective teaching, collaborative learning, and 
educating for reflective practice. In accordance with Murray’s (1991) discussion of low- 
inference behaviors, items were designed to describe specific teaching behaviors. Two items 
asked for perceptions of the classroom climate of tolerance for women and minorities. 

A principal component factor analysis of the 26 items produced 4 factors. This factor 
solution accounted for 61% of the variance in the correlation matrix and is presented in Table 2. 
Three of the four factors reflected teaching practices. Instructor Interaction and Feedback 
included ten practices that fostered frequent, supportive communication between faculty and 
students. Collaborative Learning included six practices that fostered interdependence among 
students working in groups. Clarity and Organization included three practices that involved clear 
explanations, expectations or integrated course structure. The Instructor Interaction and 
Feedback practices are consistent with Schon’s (1987) description of coaching for reflective 
practices and similar in factor structure and item composition to the “Interaction” and “Rapport” 
factor solutions reported in Murray (1991). The fourth factor grouped together perceptions of 
fairness in the treatment of minorities and women in the classroom and was labeled Classroom 
Climate (2 items). The internal consistency of the four scales was high, ranging from .81 to .92. 



Insert Table 2 



Indicators of Gains in Professional Competencies : Students were asked to report the 
progress they believe they made in 27 areas as a result of the course they were taking. Progress 
was reported on a 1 to 4 scale, where ‘l=none’, ‘2=slight’, ‘3=moderate’, and ‘4=a great deal’. 
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These items were drawn primarily (but not exclusively) from Jones and associates (1994) 
research about the essential skills college students should acquire before they graduate. The items 
were also developed to reflect, as closely as possible, 7 of the 1 1 learning outcomes articulated in 
ABET’s (1998) Engineering Criteria 2,000. (See Appendix A.) 

Several considerations guided the decision of using self-reported gains to measure 
learning outcomes instead of objective cognitive tests. Many competencies, such as ability to 
work in groups, cannot be measured by objective tests. Furthermore, locally developed or 
standardized tests for profession-specific competencies are expensive and difficult to design. 
Finally, Pike (1995) found self-reported measures of educational gains to be as valid as objective 
measures, to the extent that the measures reflect the content of the learning outcome under 
consideration. 

Table 3 presents the results of the factor analysis of the 27 gains items. The factor 
analysis yielded three factors: Gains in Design Skills (5 items). Gains in Problem Solving Skills 
(7 items), and Gains in Group Skills (7 items). This three factor solution explained 66% of the 
variance in the correlation matrix. The internal consistency of the three scales was also high, 
ranging from .87 to .92. 



Insert Table 3 



Findings 
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Relationship between Teaching Practices and Gains in Professional Competencies 



Multiple regression analyses were performed to assess the significant predictors of self- 
reported gains in group, problem-solving, and design skills. Mean substitution was used to 
replace missing values in the predictors. To examine whether variation in student development 
of professional skills had more to do with pre-college characteristics than with teaching practices, 
factors were grouped in two blocks and sequentially entered. The first block included measures 
of academic ability (SAT verbal and math scores), high school achievement (GPA), educational 
aspirations (highest degree expected), socioeconomic status (highest parental education), gender, 
ethnicity, class year (freshman to senior), and perceptions of classroom climate. The second 
block included the three measures of teaching practices (Instructor Interaction and Feedback, 
Collaborative Learning, and Clarity and Organization). 

The regression models explained 39.7 percent, 32.2 percent and 39.6 percent of the 
variance in group, communication and design competencies (see Table 4). Teaching practices 
explained considerably more of the variance in self-reported gains in professional competencies 
than did student pre-college characteristics (see Table 4). Teaching practices accounted for 29.9 
%, 26.3 % and 31.1% of the variance of gains in group, problem-solving, and design skills, 
respectively, whereas students’ pre-college characteristics, class year and classroom climate 
explained less than 10 percent of the variance. 



Insert Table 4 
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Instructional Interaction and Feedback and Collaborative Learning were associated with 
gains in all three professional competencies (see Table 5). The relative importance of the 
teaching practice as determined by standardized betas varied with the learning outcome under 
consideration. Instructional Interaction and Feedback had strong, significant, and positive 
relationships with gains in group, problem-solving and design competencies. Not surprisingly. 
Collaborative Learning was the teaching practice that had the strongest positive relationship with 
self-reported gains in group skills. Collaborative Learning, however, was also related 
significantly and positively to gains in problem-solving and design skills. Clarity and 
Organization showed no significant effect on gains in group skills, this teaching practice was 
positively and significantly related to gains in problem-solving and design competencies. 

Students’ characteristics had less effect on competencies than did teaching practices. 
Gains in group skills were negatively affected by students’ aspirations for advanced degrees, 
high SAT verbal scores, and by higher levels of parental education. The magnitude of these 
negative effects, however, were minimal. African Americans and Asian Americans reported 
significantly greater gains in communication and design skills than did their Caucasian 
counterparts.' Again, the magnitude of the effects of ethnicity on gains in professional 
competencies was much smaller than the effects of teaching practices. 



Insert Table 5 



‘The researchers will explore the relation of ethnicity to gains in professional 
competencies in more depth in a future paper. 
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Impact of Gender on Relationship between Teaching Practices and Professional Competencies 
Because retention rates continue to be lower for women than for men in engineering and 
science majors (Suter, 1996), there is particular concern that traditional lecture-style teaching 
practice used in these fields alienates women (NSF, 1996). Because of ECSEL’s goals to teach 
design and to improve diversity, we had reason to believe that at least some faculty in ECSEL ' 
surveyed for this study incorporated other teaching practices in their classrooms. Therefore, even 
though gender did not emerge as significant in the initial regression analysis, we conducted 
additional analyses to determine conclusively if there were any gender differences in perceptions 
of teaching practices, classroom climate, or gains in professional competencies . A series of t- 
test comparisond of males’ and females’ mean perceived gains in competencies and classroom 
climate revealed only one significant difference: females reported greater gains in design skills 
than their White male counterparts. No significant differences were observed in terms of gains in 
group or problem skills. Both groups reported similar levels of tolerance in the classroom 
towards women and minorities (see Table 6). 



Insert Table 6 



Additional multiple regression analyses, reported in Table 7, were performed to compare 
the significant predictors of self-reported gains in group, and problem-solving, and design skills 
for White males and for females. Mean substitution was used to replace missing values in the 
predictors. The models explained more variance in gains in proficiencies among females than 
they did among White males. Among females, the regression models accounted for 36.8 percent. 
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36.0 percent and 44.7 percent of the variance in self-reported professional gains in group, 
problem-solving and design skills. The regression models explained 41.2 percent, 24.6 percent 
and 27.2 percent of the variance in group, problem-solving, and design skills among White 
males. 



Insert Table 7 



The relationship of teaching practices with gains in group skills were similar for White 
males and for females. For both genders, Instructor Interaction and Feedback and Collaborative 
Learning had significant and positive associations with gains in group skills. Instructor 
Interaction and Feedback also had a strong and positive relationship with gains in problem- 
solving skills for both genders. Comparison of the regression models for White males and 
females, however, indicates that females’ gains in problem-solving were enhanced by 
Collaborative Learning and by Clarity and Organization. White males’ gains in problem-solving 
skills were not significantly related to those two teaching practices. There was a positive, 
significant and strong relationship between Instructor Interaction and Feedback and gains in 
design skills for both female and White male students. In addition for females— although not for 
White males— Collaborative Learning was significantly and positively associated with gains in 
design skills. No pre-college characteristics emerged as significant in these regression models. 
Classroom Climate emerged as significant in one very interesting case. White males’ perceptions 
of gains in group skills were negatively associated with their perceptions of the way women and 
minorities were treated in their class. 
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Discussion 



The findings indicate that faculty efforts in the classroom indeed have important 
influences on students’ career preparation. After all, gains in group, problem-solving, and design 
skills were more the result of teaching practices than the outcome of students’ pre-college 
characteristics. The results reported here suggest that both male and female undergraduate 
students’ gains in professional competencies can be fostered in the classroom by frequent 
interaction with and feedback from the instructor, opportunities to work collaboratively with 
peers, and by clear instructions and structure from the instructor. 

It is perhaps no surprise that students associate experiences collaborating with peers in the 
classroom with improvements in their interpersonal and group skills. Interview studies indicate 
that many students believe that the best way to learn group skills is to be forced to work in teams, 
then to learn how to cooperate by trial and error (Campbell, Bjorklund, & Colbeck, 1998). 
Another result of this study, however, is noteworthy. This study provides evidence that the 
instructor also has an important influence on improvement in students’ ability to work together 
effectively in groups. An instructor who interacts with students frequently, who guides rather 
than lectures, and who gives specific feedback and encouragement, undoubtedly provides 
students with an important model for appropriate and positive collaborative behavior. 

Such an instructor, according to the results of this study, also provides students with the 
support and information necessary to learn how to solve both simple problems and complex 
design problems. These findings support Schon’s (1987) descriptions of ways to educate 
reflective practitioners. Schon asserts that design skills cannot be imparted by lecturing. Instead, 
as was found in this study, students develop the ability to understand and reframe problems. 



imagine, explore, and test alternative solutions in a classroom where the instructor guides 
students, giving them chances to practice relating concepts to real problems, and encouraging 
them to question assumptions. 

Improvement in students’ abilities to solve problems and do design are also positively 
influenced by instructors who explain assignments and activities clearly, state their expectations 
of students explicitly, and relate assignments to content of the class. These findings that 
organization and clarity are positively associated with gains in professional competencies are 
consistent with prior research that shows that organization and clarity are consistently among the 
teaching practices associated with positive evaluations of teaching (Feldman, 1976; Murray, 
1991) and with gains in subject matter knowledge (Pascarella & Terenzini, 1991). 

Gender had little significant impact on the relationship between teaching practices and 
gain in professional competencies. In fact, in the original analysis, the effect of gender was not 
only non-significant, it was very weak. Subsequent regressions conducted separately for White 
males and females provide, at best, only minimal support premises that women are more likely 
than men to learn effectively from collaborative work, whether because of inherent learning style 
differences or as a consequence of gender role socialization. For both male and female students, 
collaborative learning fostered gains in group skills. Results indicate that gains in problem- 
solving and design skills were also significantly associated with collaborative learning female 
students, but not for White males. These findings, however, may be confounded with ethnicity, 
since the regressions for females included female students of color, and the regressions for males 
included only Whites. Moreover, the findings fail to support the premise that hostile treatment 
from male peers would make women less likely to learn effectively in small group situations. 



Thus, it appears that collaborative learning practices are associated with gains in professional 
competencies for both genders. These findings corroborate recent research evidence from Tinto 
(1997), that collaborative learning is effective in promoting college persistence, regardless of 
student’s gender or ethnicity. 

Since most students perceived that female and minority students were treated the same as 
White male students, classroom climate had no impact on self-reported gains in professional 
competencies except in one interesting case. Perceptions that all students were treated fairly was 
negatively but significantly associated with White male students’ gains in group skills. One 
possible explanation for this finding is that females and minorities are more accustomed to 
dealing with discrimination, and are therefore less surprised or more resilient than White males 
when they perceive prejudice directed at themselves or others (Cabrera & Nora, 1994). Another 
possible explanations is that some White males, accustomed to receiving more favorable 
treatment than their peers, felt some loss when females and minorities also benefitted from 
frequent interactions with instructors. 

Implications for the Practice and Assessment of Teaching 
The results of this study corroborate evidence from other research that active and 
collaborative learning activities enhance student learning (Tinto, 1997). Nevertheless, more than 
three-fourths of new and senior faculty continue to rely on lecture as their primary — or even 
their only — teaching practice (Finkelstein, Seal & Schuster, 1998). Thus, faculty persist in 
giving traditional lectures despite evidence that more faculty/student and student/student 
interaction in the classroom promotes the learning of content knowledge and professional 
competencies. Perhaps this is because faculty perceive that structuring classes for active and 



collaborative learning is complex and time consuming. Many colleges and universities create 
and maintain centers for excellence in teaching that provide faculty with in-service training about 
how to teach actively, collaboratively, and effectively. However, faculty often neglect to take 
advantage of such opportunities because they believe their institutions’ reward systems only pays 
lip service to good teaching. An assistant or associate professor confronting the competing 
demands for research and service is likely to be hesitant to demanding instructional techniques 
if these activities are neglected in promotion and salary decisions. So what can be done to 
encourage faculty to teach in ways that foster students’ development of professional 
competencies? 

Expectations on the part of accrediting agencies such as ABET that institutions be 
accountable for developing students’ professional competencies may encourage more widespread 
use of teaching practices such as instruction interaction and feedback, collaborative learning, and 
organization and clarity. The intrinsic satisfaction of contributing student development will no 
doubt continue to inspire some faculty to adopt such practices. On the other hand, departments 
and institutions should implement rewards— including sufficient time to implement changes — for 
faculty who are willing to make extra effort to help students develop competencies essential for 
their professional success. 

The assessment literature suggests at least three conditions necessary when developing 
successful performance indicators (Bordem &. Banta, 1994; Gaff, Ratcliff and associates, 1996). 
To begin, the data yielded by a performance indicator are meaningful when defined by the user. 
This implies the data the performance indicator conveys should inform the user something of 
importance about what it is taking place at the institution (Ewell, 1997). Second, performance 
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indicators are best when used as a group. The information they provide should portray a 
comprehensive picture of an institutional strategic area if they are to support strategic decisions 
(Ewell, 1997). Third, data should inform about the input and processes associated with a 
particular outcome such as student learning. The indicators of teaching practice used in this 
study meet several of the conditions recommended by the assessment literature. They evolved 
from theory, research and consultation with the users. They are meaningful to the user in that 
their content is consistent with the objectives of ECSEL’s curricular reform objectives. The 
indicators are reliable and valid; each of the scales has reliabilities that fall in the high range. The 
indicators portray a comprehensive picture of the classroom practices to which engineering 
students are exposed. They also index gains in competencies deemed essential by the coalition of 
engineering schools. Moreover, classroom practices indicators are valid in that they predict self- 
reported gains in competencies. The indicators are also consistent with recommendations from 
the literature on teaching effectiveness (e.g. Murray, 1991); they index observable behaviors (e.g. 
instructor gives frequent feedback) rather than subjective impressions (e.g. the instructor is 
caring) 
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Appendix A: 



ACCREDITATION BOARD FOR ENGINEERING AND TECHNOLOGY (ABET) 

ENGINEERING CRITERIA 2000 

Criteria for Accrediting Programs in Engineering in the United States 

Criterion 3 : Program Outcomes and Assessment: Engineering programs must demonstrate that 
their graduates have: 

a) an ability to apply knowledge of mathematics, science, and engineering 

b) an ability to design and conduct experiments as well as to analyze and interpret data 

c) an ability to design a system, component, or process to meet desired needs 

d) an ability to function on multi-disciplinary teams 

e) an ability to identify, formulate, and solve engineering problems 

f) an understanding of professional and ethical responsibility 

g) an ability to communicate effectively 

h) the broad education necessary to understand the impact of engineering solutions in a global/ 
societal context 

I) a recognition of the need for and an ability to engage in lifelong learning 

j) an ability to use the techniques, skills, and modem engineering tools necessary for engineering 
practice 
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Table 1. Descriptive statistics 



Variable 


N 


% 

Cell 


Mean 


S.D. 


Reliabilty 


Gender 












Male 


359 


77.2 








Female 


106 


22.8 








Ethnicity 












African-American 


69 


14.4 








Asian-American 


108 


22.5 








Hispanic 


32 


6.7 








Native-American 


5 


1.0 








White 


216 


45.0 








Highest parental education 


456 




5.10 


1.76 




Ability 












Sat Math 


280 




644.59 


87.34 




Sat Verbal 


279 




546.11 


101.28 




High School GPA 


372 




3.59 


.40 




Highest degree expected 


470 




2.03 


.62 




Class year 


461 




2.39 


1.07 




Teaching practices: 












Instructor Interaction & 












Feedback 


426 




2.59 


.65 


.92 


Collaborative Learning 


444 




2.93 


.77 


.83 


Clarity & Organization 


459 




3.17 


.67 


.81 


Gains in: 












Group Skills 


420 




2.69 


.84 


.92 


Problem Solving 


432 




2.85 


.68 


.90 


Design Skills 


439 




2.70 


.74 


.87 


Classroom Climate 


437 




3.68 


.57 


.89 
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Figure 1. Teaching for Professional Competence Model 
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Table 2. Classroom Practices: Factor Analysis 
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Table 3. Learning Outcomes: Factor Analysis 
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Table 4. Contribution of Teaching Practices to Variance in Professional Competencies 



Outcome 


Baseline 

Model' 


Adding 

Teaching 

Practices 


R^ 

Change 


Gains in; 
Group Skills 


.098 


.397 


.299* 


Problem Solving 


.059 


.322 


.263* 


Design Skills 


.085 


.396 


.311* 



' Baseline model controls for pre-college characteristics, academic ability, motivation, 
class year and classroom climate. 



Table 5. Regression results (Standardized Betas) 



Variable 


Group 

Skills 


Problem Solving 
Skills 


Design 

Skills 


Male 


.004 


-060 


-.070 


Ethnicity 








African-American 


.101 


.124** 


.092** 


Asian-American 


.085 


.094* 


.090** 


Hispanic 


.070 


.016 


.057 


Highest parental education 


-.079* 


-.006 


-.010 


Ability 








Sat Math 


-.076 


.031 


-.037 


Sat Verbal 


-091* 


-.019 


-.067 


High School GPA 


.007 


.026 


-.011 


Highest degree expected 


-.082* 


-.017 


-.030 


Class year 


.004 


-.013 


.041 


Teaching practices: 
Instructor Interaction & 








Feedback 


.264** 


.253** 


.304** 


Collaborative Learning 


.394** 


.212** 


.220** 


Clarity & Organization 


-.040 




.190** 


Classroom Climate 


-.065 


.038 


.024 




.397 


.322 


.396 


R} adjusted 


.378 


.302 


.378 


F test 


21.83** 


15.78** 


21.80** 



* p < .05; **p< .01 
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Table 6. Group Differences in Gains in Professional Competencies and perceptions of 
Classroom Climate 





Means 


r-test 

of 

means 


p-value 


White 

Male 


Female 


A. Gains 










Group Skills 


2.55 


2.71 


-1.33 


.184 


Problem-Solving Skills 


2.73 


2.90 


-1.88 


.062 


Design Skills 












2.58 


2.78 


-2.05 


.042 


B. Classroom Climate 


3.74 


3.63 


1.44 


.151 
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Table 7. Regression results for females and White males (Standardized Betas) 
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